Reinforcement learning in a multi-agent framework for pedestrian simulation

El objetivo de la tesis consiste en la utilización de Aprendizaje por refuerzo (Reinforcement Learning) para generar simulaciones plausibles de peatones en diferentes entornos. Metodología Se ha desarrollado un marco de trabajo multi-agente donde cada agente virtual que aprende un comportamiento de navegación por interacción con el mundo virtual en el que se encuentra junto con el resto de agentes. El mundo virtual es simulado con un motor físico (ODE) que está calibrado con parámetros de peatones humanos extraídos de la bibliografía de la materia. El marco de trabajo es flexible y permite utilizar diferentes algoritmos de aprendizaje (en concreto Q-Learning y Sarsa(lambda) en combinación con diferentes técnicas de generalización del espacio de estados (en concreto cuantización Vectorial y tile coding). Como herramientas de análisis de los comportamientos aprendidos se utilizan diagramas fundamentales (relación velocidad/densidad), mapas de densidad, cronogramas y rendimientos (en términos del porcentaje de agentes que consiguen llegar al objetivo). Conclusiones: Tras una batería de experimentos en diferentes escenarios (un total de 6 escenarios distintos) y los correspondientes analisis de resultados, las conclusiones son las siguientes: - Se han conseguido comportamientos plausibles de peatones -Los comportamientos son robustos al escalado y presentan capacidades de abstracción (comportamientos a niveles táctico y de planificación) -Los comportamientos aprendidos son capaces de generar comportamientos colectivos emergentes -La comparación con otro modelo de peatones estandar (Modelo de Helbing) y los análisis realizados a nivel de diagramas fundamentales, indican que la dinámica aprendida es coherente y similar a una dinámica de peatones

Prior oral conditions in patients undergoing heart valve surgery

Patients scheduled for heart valve surgery should be free of any oral infectious disorders that might pose a risk in the postoperative period. Few studies have been made on the dental conditions of such patients prior to surgery. The present study describes the most frequent prior oral diseases in this population group. A prospective, observational case-control study was designed involving 60 patients (30 with heart valve disease and 30 controls, with a mean age of 71 years in both groups). A dental exploration was carried out, with calculation of the DMFT (decayed, missing and filled teeth) index and recording of the periodontal parameters (plaque index, gingival bleeding index, periodontal pocket depth, and attachment loss). The oral mucosa was also examined, and panoramic X-rays were used to identify possible intrabony lesions. Significant differences in bacterial plaque index were observed between the two groups (p<0.05), with higher scores in the patients with valve disease. Probing depth and the presence of moderate pockets were also greater in the patients with valve disease than among the controls (p<0.01). Sixty percent of the patients with valve disease presented periodontitis. Patients scheduled for heart valve surgery should be examined for possible active periodontitis before the operation. Those individuals found to have periodontal disease should receive adequate periodontal treatment before heart surgery

Shared Preferences by Predators and Females for Male Ornaments in Swordtails

Sexually dimorphic traits in many mate recognition systems have evolved in response to preexisting female biases. These biases are often quite general in form and are likely to be shared by predators, thereby imposing a cost on male trait expression. The Mexican tetra Astyanax mexicanus (Pisces: Characidae), a visual predator of swordtail fishes, exhibits the same visual preferences for male body size morphs as do females. Furthermore, tetras in populations where swordtails are absent prefer males with sword ornaments over males with swords removed. The predator preference is thus likely to have arisen prior to contact with fishes beating the ornaments, as has also been suggested for mating preferences for swords.Waller Creek Working Grou

Applications of Hydro-Chemical and Isotopic Tools to Improve Definitions of Groundwater Catchment Zones in a Karstic Aquifer: A Case Study

Some researchers have proposed the groundwater protection zone (GPZ) method as a methodological framework for defining safeguard zones of groundwater bodies. Its goal is to protect the quality of water intended for human consumption and to facilitate a common implementation of this method in all European Union member states. One of the criteria used to establish GPZs is to define contributing catchment areas (CCAs). This methodology has been applied to the Sierra de Cañete, a region comprising a carbonate aquifer in the province of Malaga, Spain. The tools used to define CCAs are hydro-chemical and isotopic characterizations, namely water isotopes (i.e., 2H, 18O and tritium) and the isotopes of dissolved sulfates (i.e., 34S and 18O). Traditionally, the Sierra de Cañete aquifer has been divided into six sectors. Hydro-chemical and isotopic characterization differentiated between two large areas in the carbonate aquifer. The southern part presents younger water that is the result of faster recharge and that shows a high level of karstification, while the northern area has a slower flow, and recharge is produced over several years. In addition, the northern part is hydraulically connected to an alluvial aquifer (i.e., Llanos de Almargen) that borders the Sierra de Cañete to the north. This aquifer has high levels of pollution due to agricultural and livestock activities carried out in the Llanos de Almargen area. This pollution is transmitted to the carbonate aquifer when groundwater depletion occurs. Therefore

Ethanol-Induced Oxidative Stress Modifies Inflammation and Angiogenesis Biomarkers in Retinal Pigment Epithelial Cells (ARPE-19): Role of CYP2E1 and its Inhibition by Antioxidants

The retinal pigment epithelium (RPE) plays a key role in retinal health, being essential for the protection against reactive oxygen species (ROS). Nevertheless, excessive oxidative stress can induce RPE dysfunction, promoting visual loss. Our aim is to clarify the possible implication of CYP2E1 in ethanol (EtOH)-induced oxidative stress in RPE alterations. Despite the increase in the levels of ROS, measured by fluorescence probes, the RPE cells exposed to the lowest EtOH concentrations were able to maintain cell survival, measured by the Cell Proliferation Kit II (XTT). However, EtOH-induced oxidative stress modified inflammation and angiogenesis biomarkers, analyzed by proteome array, ELISA, qPCR and Western blot. The highest EtOH concentration used stimulated a large increase in ROS levels, upregulating the cytochrome P450-2E1 (CYP2E1) and promoting cell death. The use of antioxidants such as N-acetylcysteine (NAC) and diallyl sulfide (DAS), which is also a CYP2E1 inhibitor, reverted cell death and oxidative stress, modulating also the upstream angiogenesis and inflammation regulators. Because oxidative stress plays a central role in most frequent ocular diseases, the results herein support the proposal that CYP2E1 upregulation could aggravate retinal degeneration, especially in those patients with high baseline oxidative stress levels due to their ocular pathology and should be considered as a risk factor.LVG was recipient of a pre-doctoral fellowship (EDUCV-PRE-2015-006). Financial support by grant #94/2016 from the PROMETEO program from the Generalitat Valenciana, Valencia, Spain, to FJR

Using Inverse Reinforcement Learning with Real Trajectories to Get More Trustworthy Pedestrian Simulation

Reinforcement learning is one of the most promising machine learning techniques to get intelligent behaviors for embodied agents in simulations. The output of the classic Temporal Difference family of Reinforcement Learning algorithms adopts the form of a value function expressed as a numeric table or a function approximator. The learned behavior is then derived using a greedy policy with respect to this value function. Nevertheless, sometimes the learned policy does not meet expectations, and the task of authoring is difficult and unsafe because the modification of one value or parameter in the learned value function has unpredictable consequences in the space of the policies it represents. This invalidates direct manipulation of the learned value function as a method to modify the derived behaviors. In this paper, we propose the use of Inverse Reinforcement Learning to incorporate real behavior traces in the learning process to shape the learned behaviors, thus increasing their trustworthiness (in terms of conformance to reality). To do so, we adapt the Inverse Reinforcement Learning framework to the navigation problem domain. Specifically, we use Soft Q-learning, an algorithm based on the maximum causal entropy principle, with MARL-Ped (a Reinforcement Learning-based pedestrian simulator) to include information from trajectories of real pedestrians in the process of learning how to navigate inside a virtual 3D space that represents the real environment. A comparison with the behaviors learned using a Reinforcement Learning classic algorithm (Sarsa(λ)) shows that the Inverse Reinforcement Learning behaviors adjust significantly better to the real trajectories

Convective heat transfer performance of thermal oil-based nanofluids in a high-temperature thermohydraulic loop

Enhancing the performance of heat transfer fluids (HTF) is a key target for improving the efficiency of many industrial processes. Employing nanofluids for this purpose, by dispersing nanoparticles into the initial HTF to improve its thermo-physical properties, is one possible way to increase its heat transfer capacity. However, testing these properties at high temperature is not always easy. An experimental setup consisting of a thermohydraulic loop for high-temperature heat transfer measurements was developed in this work. The accuracy and repeatability of the measurements taken in the heat transfer loop were ensured. A nanofluid consisting of a commercial thermal oil, doped with Sn nanoparticles at 1 wt% and olive oil surfactant used to enhance colloidal stability, was tested and compared to the results obtained for the base fluid and the base fluid/stabiliser mixture employing their experimentally measured thermo-physical properties. The nanofluid generally enhanced the convective heat transfer coefficient in relation to the base fluid with enhancements of up to 7.23% at 200 °C and 9.43% at 140 °C vs. the pure base fluid.Funding for open access charge: CRUE-Universitat Jaume

Placebo-controlled trial of nimodipine in the treatment of acute ischemic cerebral infarction

Nimodipine is a 1,4-dihydropyridine derivative that shows a preferential cerebrovascular activity in experimental animals. Clinical data suggest that nimodipine has a beneficial effect on the neurologic outcome of patients suffering an acute ischemic stroke. Our double-blind placebo-controlled multicenter trial was designed to assess the effects of oral nimodipine on the mortality rate and neurologic outcome of patients with an acute ischemic stroke. One hundred sixty-four patients were randomly allocated to receive either nimodipine tablets (30 mg q.i.d.) or identical placebo tablets for 28 days. Treatment was always started less than or equal to 48 hours after the acute event. The Mathew Scale, slightly modified by Gelmers et al, was used for neurologic assessment. Mortality rate and neurologic outcome after 28 days were used as evaluation criteria. We considered 123 patients to be valid for the analysis of efficacy. Mortality rates did not differ significantly between groups. Neurologic outcome after 28 days of therapy did not differ between groups. However, when only those patients most likely to benefit from any intervention (Mathew Scale sum score of less than or equal to 65 at baseline) were analyzed separately in post hoc-defined subgroups, the nimodipine-treated subgroups showed a significantly better neurologic outcome. This result suggests that some patients with acute ischemic stroke will benefit from treatment with nimodipine tablets

Role of CD5/CD5L interactions in the homeostasis of regulatory lymphocyte subpopulations and the control of autoimmune disorders

Resumen del trabajo presentado al: "6th European Workshop on Immune-Mediated Inflammatory Diseases" celebrado en Niza (Francia) del 23 al 25 de noviembre de 2011.-- et al.Peer Reviewe

Peritoneal Dissemination of Hepatoid Carcinoma of the Ovary Treated with Cytoreductive Surgery and Hyperthermic Intraoperative Intraperitoneal Chemotherapy

Hepatoid carcinoma of the ovary (HCO) was first reported in 1987 in 5 cases of malignant ovarian tumors which were similar to hepatocarcinoma in the histological analysis. We report the first case in the literature of a patient diagnosed with HCO treated using HIPEC after extensive cytoreductive surgery, and we discuss the value of this therapeutical option in patients with HCO